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USING TWO CLASSES OF CHANNELS WITH DIFFERENT CAPACITY 
FIELD OF THE INVENTION 

The present invention relates to a cellular communication 
system with adaptive antenna arrays, and more specifically to 

_ 5 a-cellular nmnmunication s ystem which uses both wide adaptive 

antenna lobes and narrow adaptive antenna lobes for com- 
munication between base stations and mobile stations. 

BACKGROUND OF THE I NVENTION 

The cellular industry has made phenomenal strides in commer- 
10 cial operations in the United States as well as the rest of 
the world. Growth in major metropolitan areas has far 
exceeded expectations and is outstripping system capacity. 
If this trend continues, the effects of rapid growth will soon 
be achieved in the smallest markets. Innovative solutions are 
15 required to meet these increasing capacity needs as well as to 
maintain high quality service and avoid . rising prices. 
Furthermore, as the number of cellular users increases, the 
problems associated with co-channel interference become of 
increased importance. 

20 Current digital cellular systems employ base stations which 
separate mobile signals using time and frequency ort- 
hogonality. Signals from a mobile propagate to a base station 
and the signals are received in a single or sometimes double 
antenna. The receiver processes the signal using time and 

25 frequency orthogonality to separate signals from different 
users. It is then possible to equalize and detect the 
signals. While techniques such as frequency hopping and 
advanced coding techniques provide ways for lowering co- 
channel interference, they are inherently limited by the 

30 available frequency spectrum. However, the use of the 
directional sensitivity of adaptive antennas offers a new way 
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of reducing co-channel interference* . An adaptive antenna 
consists of an array of spatially distributed antennas. 
Impinging on the array are signals from several transmitters. 
By properly combining the antenna outputs, it is possible to 
5 extract individual signals from the received superposition, 
even if they occupy the same frequency band. It is then 
possible to distinguish between spatially separated users by 
using narrow adaptive antenna lobes. This can be viewed as a 
way to utilize orthogonality in the spatial dimension. 

10 Current digital cellular systems also employ base stations 
which use base antennas with wide antenna lobes, i.e., 
approximately 60, 120 or 360*. The base station receives 
signals from all mobile stations within the lobe. It is hence 
not necessary to know the position of the mobile station. 

15 However, it is not possible to suppress mobiles transmitting 
from other angles. The use of narrow adaptive antenna lobes 
requires that the position or more exactly, the best spatial 
filters for reception/transmission to and from the mobile 
station be known. This implies that the spatial filters of 

20 the mobile must be measured for each new call and after each 
handover between base stations. 

This measurement problem can be easily solved in many ap- 
plications. However, the problem is much more important in 
cellular mobile applications where the mobile stations change 

25 position and where communication channels fade quickly. 
Furthermore, existing standards such as the GSM standard often 
assume that a wide antenna lobe is used so that valuable 
information can be sent directly to mobile stations with 
unknown positions. This implies that special care must be 

30 taken so that information is not lost during the training of 
the adaptive antennas. Another consideration is the linking 
to a channel, i.e., the fact that a mobile can be assigned to 
one of a number of time and/or frequency orthogonal channels. 
A new mobile may not be appropriate for a specific channel 
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since, for example, it is close to an old mobile on the same 
channel- There is hence a desire to first measure, without 
disturbing any traffic, and then to link the mobile to an 
appropriate channel. In other words, one should maximize the 
5 spatial orthogonality. 

Another important considerat ion is handover measurem ents. 
There is a desire to have some channels transmitted in a wide 
lobe so that the mobile station can measure the signal 
strength of the signal from the base stations. 

10 SUMMARY OF THE DI SCLOSURE 

It is an object of the present invention to provide a system 
wherein mobile stations with known and unknown positions can 
be used in the same system while the knowledge about the 
mobile" s position at the same time can be utilized to reduce 
15 interference and increase system capacity. This object of the 
present invention is accomplished by using antenna arrays and 
by dividing the available traffic channels into a plurality of 
classes. 

one embodiment of the present invention discloses a method of 
20 transmitting and receiving signals in a base station with an 
antenna array in a cellular communication system. First, the 
available communication channels are divided into a plurality 
of classes. The base station then transmits signals to mobile 
stations in a first class of channels with a wide antenna 
25 lobe. The position of a mobile station can then be determined 
from signals received at the base station from the mobile 
station. After the position of the mobile station has been 
determined, the base station can transmit signals to and 
receive signals from the mobile station in a second class of 
30 channels with a narrow antenna lobe. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will now be described in more detail 
with reference to preferred embodiments of the present 
invention, given only by way of example, and illustrated in 
5 the accompanying drawings in which; 

Figure 1 illustrates a block diagram of the relationship 
between the transmitter and the receiver; 

Figures 2 (a) -(b) illustrates one antenna arrangement accor- 
ding to one embodiment of the present invention; 
10 Figure 3 is a flow chart of a call set up routine according to 
one embodiment of the present invention; 

Figure 4 illustrates an example of beam-forming according to 
one embodiment of the present invention; 

Figure 5 illustrates a flow chart for detecting and demodulat- 
15 ing a signal according to one embodiment of the present 
invention; 

Figure 6 illustrates a block diagram of one embodiment of a 
part of the present invention; 

Figure 7 (a) -(b) illustrates another antenna arrangement 
20 according to one embodiment of the present invention; and 

Figure 8 is a flow chart of a handover routine between base 
stations according to one embodiment of the present invention. 

DETAILED DESCRIPTION 

While the following description is in the context of cellular 
25 communication systems involving portable or mobile radio 
telephones and/or personal communication networks and a 
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plurality of base stations, it will be understood by those 
skilled in the arts that the present invention may be applied 
to other communications applications. 

Figure 1 illustrates an overview picture of the link between 
5 a transmitter 10 and a receiver 14. The transmitter and 
receiver are located in both the mobil e station and the base 
stations, however for this discussion the transmitter 10 is in 
the mobile station and the receiver 14 is located at the base 
station. The transmitter 10 sends a signal to the receiver 14 

10 through a channel 12. The channel 12 is considered to be a 
linear transfer function with an impulse response h(t) which 
creates all the variations and phase and signal strength 
between the transmitter and the receiver. The transmitted 
signal s(t) is affected by the channel impulse response h(t) 

15 to form a received signal r(t) . The signal r(t) is received 
by the receiver 14 through an adaptive antenna array 20 which 
feeds the received signal into a channel estimator 16 which 
calculates a discrete approximation to h(t) called h(n) . The 
discrete approximation h(n) is then fed into the fading 

20 frequency estimator 18 which produces an estimate of the 
doppler frequency for the mobile station. The received signal 
is also feed into a demodulator/detector 22 which uses the 
channel estimate and a doppler frequency estimate to demodu- 
late and dete A c(*)the signal s 

25 According to one embodiment of the present invention, the 
number of available traffic channels are divided into a 
plurality of groups or classes, for instance, two. According 
to one embodiment of the present invention, the first class of 
channels has a disturbance situation so that the base station 

30 can receive signals using wide antenna lobes and transmit 
signals to the mobile station using a wide antenna lobe. The 
second class of channels has a disturbance situation so that 
the base station must transmit signals using narrow antenna 
lobes in order to obtain acceptable quality. The difference 
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between the channel classes is that a narrow lobe channel 
where the base station transmits signals in a narrow antenna 
lobe has a significantly higher spectral efficiency. The 
higher spectral efficiency can typically be used to reduce the 
5 frequency reuse or to enable multiple spatial separated users 
to communicate over the same channel. Typically, the control 
channel and some of the traffic channels should be class one 
channels while most of the traffic channels should be class 
two channels. Furthermore, the class one channels should use 
10 the same reuse distance and receiver algorithms as are 
presently available today, while the class two channels can 
have a smaller reuse distance than the class one channels. 

Figure 2(a) illustrates a wide lobe channel. As is 
illustrated, the channel fl is broadcast over a wide area so 

15 that a plurality of mobile stations can receive broadcast 
messages from the base station independently of their posi- 
tion. Figure 2 (b) illustrates a narrow lobe channel according 
to one embodiment of the present invention. As is illustra- 
ted, the channel f2 is broadcasted to a limited area using the 

20 spatial filters of the adaptive antenna array to limit the 
direction of channel f2. As a result, the channel f2 can be 
used by a plurality of mobile stations to transmit and receive 
individual messages, so long the mobile stations are not 
located in the same vicinity. 

25 According to one embodiment of the present invention, a base 
station transmits broadcast information, control messages, 
and paging messages on a wide lobe downlink channel. The base 
station also listens to all of the mobile stations in its 
assigned geographical area on a wide lobe uplink channel 

30 where, for example, mobile stations can send access requests 
to the base station. The base station collects the signals 
from the surrounding area at the antenna array. The collected 
signals are then entered into a signal processor which 
evaluates all of the individual signals to detect the presence 
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of a mobile station and to measure the position of the mobile 
station. The base station can then use these position 
measurements to reduce the width of the antenna lobe used to 
send signals to particular mobile stations, i.e., assign the 
5 mobile station a class two channel, after the position of the 
mobile station is determined to be above a predetermined level 
of certainty. 

Class one channels are also used for setting up a new call and 
for handover between base stations. A typical call set up 

10 routine according to one embodiment of the present invention 
is illustrated in Figure 3. First, a mobile station sends an 
access message on a random access control channel, which is a 
class one channel, to a base station in step 300. The message 
is detected and used as a training sequence for the antenna 

15 algorithm, in step 302, by demoting the vector signal from the 
antenna array at time K as X(K) = [X, (K) . . *X L (K) ] T where L is the 
number of array elements. The message sequence (d(K) can 
for example be used as-the desired signal in a least-squares 
problem as follows. First, the linear combination of X(K) 

20 closest to d(K) is determined, in other words, the vector W is 
determined so that (d^-W^) 2 is minimized. The determined 
vector, W 0 , where W 0 = [W. . .W 2 J T , can then be used to filter out 
the signal from the mobile. The base station then assigns the 
mobile station an available class one channel for the re- 

25 quested call in step 304. The position of the mobile station 
can then be measured while the mobile station uses the class 
one channel to transmit data. 

The position of the mobile station can, for example, be 
characterized by the previously determined vector W 0 . It is 
30 also possible to determine a direction of arrival of the 
signal from the mobile station using well known algorithms 
such as beam-forming, MUSIC, ESPRIT, and WSF. An example of 
beam-forming is illustrated in Figure 4. The signal from a 
mobile station is received in a number of lobes, for example, 
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four lobes. The beam-forming could, for example, be done with 
four separate directional antennas 402, with a Butler beam- 
former 404 on the radio frequency signal or at base band with 
digital filters. Figure 5 illustrates one process for 
5 detecting and demodulating a signal from a mobile station. In 
step 500, a signal from a mobile station is received at the 
antenna array 402. Lobes are then formed in step 502 and the 
output power from each of the lobes is measured in step 504. 
The lobe with the largest measured power is then selected as 

10 the best lobe in step 506. The lobe number, i.e., 1,2,3,4, is 
then a characterization of the position of the mobile station. 
The desired signal is then filtered out in step 508 and the 
signal is detected and demodulated in step 510. The resulting 
signal is then checked to see if it is useable, for example, 

15 has sufficient signal strength, in step 512. If the signal is 
not useable, the selected lobe is marked as used in step 514 
and the routine returns to step 502. 

Figure 6 illustrates one method for measuring the power of 
signals received from mobile station MSI. The array of 

20 antennas 602 receive a plurality of signals, some of which are 
from MSI. The plurality of signals are then filtered in a 
spatial filter 604. The spatial filtering can reduce inter- 
ference from other directions in the uplink direction. It can 
also reduce the downlink disturbance from the base station 

25 towards the mobile station. In the uplink direction, the 
weights of the spatial filter W 1# W 2 , W 3 , and W 4 are chosen so 
that the filtered signal Y(K) consists solely of the signals 
received from the mobile station MSI. In the downlink 
direction, the weight of the spatial filter are chosen so that 

30 all of the signals for MSI reach MSI without disturbing MS2. 
The filtered signal Y (K) is then squared in a squaring means 
606 to produce the momentaneous power of the mobile station 
MSI. The momentaneous power is then averaged in time in an 
integrator 408 to produce the time averaged power of the 

35 mobile station MSI. Returning to Figure 3, as soon as the 
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position and power level of the new mobile are determined in 
step 3 06, the mobile station can then be assigned a class two 
channel in step 308. 

Traffic to and from mobiles with known positions can be 
5 directed in specific directions using narrow antenna lobes. 
As a result, interference is reduced and multiple mobiles can 
use the same frequency channel. According to one embodiment 
of the present invention, a single frequency channel can have 
up to 5 users at the same time but is not limited thereto. A 

10 mobile that wants to access an AMPS-type FDMA system would 
typically send its access request or call setup request to a 
base station using a widelobe channel as indicated in Figure 
2(a). The signal is processed by the base station and the 
mobile's position can then be measured. The mobile is then 

15 instructed to transmit and receive on a narrow band channel as 
illustrated in Figure 2 (b) . 

An active mobile in a ADC-type TDMA system would, as 
illustrated in Figure 7 (a) -(b), typically use one time slot 
for transmission to the base station and another timeslot for 

20 reception from the base station. This transmission would 
typically use narrowlobe channels with high spectral ef- 
ficiency as illustrated in Figure 7a. The mobile is then free 
for the rest of the time slots to listen for information 
broadcasted from base stations in the general vicinity on 

25 widelobe channels as illustrated in Figure 7b. 

A typical call handover routine according to one embodiment of 
the present invention is illustrated in Figure 8. When a 
first base station determines that a handover is required 
using one of the methods that are well known to one of 
30 ordinary skill in the art in step 800, the first base station 
hands off the mobile station to a second base station in step 
802. The second base station then assigns the mobile station 
an available class one channel in step 804 so that the mobile 
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station can continue the call in progress . The position of 
the mobile station is then gradually determined by either the 
base station or the mobile station in step 806. The second 
base station the assigns the mobile station an available class 
5 two traffic channel in step 808. Furthermore, according to 
one embodiment of the present invention, while the mobile 
station is transmitting on a class two channel, the mobile 
station can make handover measurements by monitoring the class 
one channels as long as the signals are separated in time. 

10 According to another embodiment of the present invention, the 
class two channels have antenna lobes with variable widths, 
wherein all of the widths of the antenna lobes of class two 
channels are less than the width of antenna lobes of class one 
channels. As a result, as the position of a mobile station is 

15 gradually determined, the base station can gradually reduce 
the antenna lobe width of the class two channel assigned to 
the mobile station. As a result, the signal quality of the 
mobile station can be gradually increased. 

It would be appreciated by those of ordinary skill in the art 
20 that the present invention can be embodied in other specific 
forms without departing from the spirit or essential character 
thereof. The presently disclosed embodiments are therefore 
considered in all respects to be illustrative and not restric- 
tive. The scope of the invention is indicated by the appended 
25 claims rather than the foregoing description, and all changes 
which come within the meaning and range of equivalence thereof 
are intended to be embraced therein. 
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WE CLAIM : 

1. A method for transmitting and receiving signals at a base 
station with an antenna array in a cellular communication 
system, comprising the steps of: 

5 dividing available communication channels into a 

plurality of classes; 

transmitting signals to a plurality of mobile stations 
in a first class of channels with a wide antenna lobe; 

determining position of a mobile station from signals 
10 received from said mobile station; 

transmitting signals to said mobile station in a second 
class of channels with a narrow antenna lobe when the position 
of said mobile is determined; and 

receiving signals from said mobile station with an 
15 adjustable lobe widths on both channel classes. 

2. A method according to claim 1, wherein said first class 
of channels is used for call set-up. 

3. A method according to claim 2, wherein the position of 
said mobile station is determined by: 

20 measuring the power level of signals received from said 

mobile station; and 

determining a proper antenna lobe for a newly connected 
mobile station. 

4. A method according to claim 1, wherein said base station 
25 assigns said mobile station to a channel in said second class 

of channels after the position of said mobile station is 
determined to be above a predetermined level of certainty. 

5. A method according to claim 1, wherein said first class 
of channels is used for handover between base stations. 

30 6. A method according to claim 5, further comprising the 
steps of: 
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transmitting and receiving signals at a mobile station 
on a channel in said second class of channels; and 

performing handover measurements of signals received at 
said mobile station on said first class of channels, 

7. A method according to claim 1, wherein at least one 
"control channel and a minorityof traffic channels belong to 
the first class of channels. 

8. A method according to claim 1, wherein said second class 
of channels has a smaller reuse distance than said first class 
of channels. 

9. A method according to claim 1, wherein said second class 
of channels can have more than one user for each channel. 

10. A method according to claim 1, wherein said second class 
of channels can have variable antenna lobe widths. 

11. A method according to claim 10, wherein the base station 
gradually reduces the antenna lobe width of a second class 
channel assigned to a mobile station as the base station 
gradually determines the position of said mobile station. 

12. A communication system with at least one base station 
having an antenna arrays, comprising; 

means for transmitting signals from a base station to a 
plurality of mobile stations on a plurality of classes of 
channels; 

means for receiving signals from a plurality of mobile 
stations at a base station on a plurality of classes of 
channels; 

means for determining a position of a mobile station from 
said received signals, wherein said base station transmits 
signals in a first class of channels with a wide antenna lobe 
and said base station transmits signals in a second class of 
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channels with a narrow antenna lobe when the position of said 
mobile station has been determined. 

13. A cellular communication system according to claim 12, 
wherein said first class of channels is used for call set-up. 

5 14. A cellular communication system according to claim 12, 
wherein said first class of channels is used for handover 
between base stations. 

15. A cellular communication system according to claim 13, 
wherein said position determining means comprises: 

10 means for determining a power level of a signal from said 

mobile station; and 

means for determining a proper antenna lobe for a newly 
connected mobile station. 

16. A cellular communication system according to claim 13, 
15 wherein said base station assigns said mobile station to a 

channel in said second class of channels after the position of 
said mobile is determined to be above a predetermined level of 
certainty. 

17. A cellular communication system according to claim 14, 
20 wherein a mobile station contains means for transmitting and 

receiving signal on a channel in said second class of channels 
and means for measuring handover measurements on a channel in 
said first class of channels. 

18. A cellular communication system according to claim 17, 
25 said mobile station further comprising means for transmitting 

and receiving signals on a channel in said first class of 
channels. 
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19. A cellular communication system according to claim 12, 
wherein at least one control channel and a minority of traffic 
channels belong to the first class of channels. 

20. A cellular communication system according to claim 12 , 
5 wherein said second class of channels have a smaller reuse 

distance than said first class of channels. 

21. A cellular communication system according to claim 12 , 
wherein said second class of channels can have more than one 
user for each channel. 

10 22. A cellular communication system according to claim 12, 
wherein said second class of channels have variable antenna 
lobe widths. 

23. A cellular communication system according to claim 22, 
wherein the base station gradually reduces the antenna lobe 
15 width of a class two channel assigned to a mobile station as 
the base station gradually determines the position of said 
mobile station. 
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